Natural Language Navigation Support in Virtual Reality
نویسندگان
چکیده
We describe our work on designing a natural language accessible navigation agent for a virtual reality (VR) environment. The agent is part of an agent framework, which means that it can communicate with other agents. Its navigation task consists of guiding the visitors in the environment and to answer questions about this environment (a theatre building). Visitors are invited to explore this building, ask questions and get advice from the navigation agent. A 2D map has been added to the environment so that visitors can make references to the locations and objects on this map, both in natural language and by clicking with the mouse, making it a multimodal system with cross-modality references.
منابع مشابه
Determining Components of Medical Instructional Design based on Virtual Reality by Research Synthesis
Introduction: The purpose of the present study was to determine the components of medical education design based on virtual reality by research synthesis method. Methods: In the present study a synthesis method was used. In order to study the research background and to collect appropriate data among the databases of Science Direct, Springer, Scopus, ProQuest and Eric (ERIC) search. With the ke...
متن کاملFractVRML: A New Proposition to Extend X3D with Fractal Geometry
Fractal geometry is a branch of mathematics that has found applications in different sciences. Natural phenomena that are not specifiable with thousands of mathematical formulae can be modeled easily with fractals. Virtual reality uses interactive simulation of real world to simulate a sense of presence in a real or imaginable environment. Because of increasing demand for virtual worlds, and th...
متن کاملA Spoken Dialogue System for Navigation in Non-Immersive Virtual Environments
Navigation is the process by which people control their movement in virtual environments and is a core functional requirement for all virtual environment (VE) applications. Users require the ability to move, controlling orientation, direction of movement and speed, in order to achieve a particular goal within a VE. Navigation is rarely the end point in itself (which is typically interaction wit...
متن کاملMultimodal Interactions with Agents in Virtual Worlds
In this chapter we discuss our research on multimodal interaction in a virtual environment. The environment we have developed can be considered as a ‘laboratory’ for research on multimodal interactions and multimedia presentation, where we have multiple users and various agents that help the users to obtain and communicate information. The environment represents a theatre. The theatre has been ...
متن کاملJacob: A Web-based Learning Environment Using Virtual Reality
This paper gives an overview of the Jacob project. This project involves the construction of a 3D virtual environment where an animated human-like agent called Jacob gives instruction to the user. The project investigates virtual reality techniques and focuses on three issues: the software engineering aspects of building a virtual reality system, the integration of natural language interaction ...
متن کامل